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Abstract 

A class of queueing networks which may have an arbitrary topol- 
ogy, and consist of single-server fork-join nodes with both infinite and 
finite buffers is examined to derive a representation of the network dy- 
namics in terms of max-plus algebra. For the networks, we present a 
common dynamic state equation which relates the departure epochs 
of customers from the network nodes in an explicit vector form de- 
termined by a state transition matrix. It is shown how the matrices 
inherent in particular networks may be calculated from the service 
times of customers. Since, in general, an explicit dynamic equation 
may not exist for a network, related existence conditions are estab- 
lished in terms of the network topology. 

Key-Words: max-plus algebra, dynamic state equation, fork-join 
queueing networks, finite buffers, blocking of servers. 



1 Introduction 

We consider a class of queueing networks with single-server nodes and cus- 
tomers of a single class. In the networks, the server at each node is supplied 
with a buffer which may have both infinite and finite capacity. There is, 
in general, no restriction on the network topology; in particular, both open 
and closed queueing networks may be included in the class. 

In addition to the ordinary service procedure, specific fork-join opera- 
tions [U |2] may be performed in each node of the networks. In fact, these 
operations allow customers (jobs, tasks) to be split into parts, and to be 
merged into one, when circulating through the network. The fork-join for- 
malism proves to be useful in the description of dynamical processes in a 
variety of actual systems, including production processes in manufacturing, 
transmission of messages in communication networks, and parallel data pro- 
cessing in multi-processor systems [1]. As an example, one can consider the 
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splitting of a message into packets, and the merging of the packets to restore 
the message, inherent in communication systems. 

In this paper, the networks are examined so as to represent their dynam- 
ics in terms of max-plus algebra [21 IH [5] . The max-plus algebra approach 
actually offers a quite compact and unified way of describing system dynam- 
ics, which may provide a useful framework for analytical study and computer 
simulation of discrete event systems including systems of queues. 

It has been shown in [6l E] that the evolution of both open and closed 
tandem queueing systems may be described by the linear algebraic equation 

d(k) = T(k)®d(k-l), (1) 

where d{k) is a vector of departure epochs from the queues, T{k) is a matrix 
calculated from service times of customers, and ® is an operator which 
determines the matrix-vector multiplication in the max-plus algebra. In 
fact, this equation quite frequently occurs in discrete event system analysis 
and simulation which are based on the max-plus algebra approach. One can 
find a variety of related examples in [21 EJ El \S\ • 

The purpose of this paper is to show that the dynamics of the networks 
under examination also allows of representation through dynamic state equa- 
tion dU) . We start with preliminary max-plus algebra definitions and related 
results in Section [21 Furthermore, Section [2] gives a general description of 
the network model, and shows how the dynamics of nodes may be described 
through scalar equations in terms of max-plus algebra. In Section [H the 
scalar equations are extended to produce a vector representation of the dy- 
namics of the entire network. Finally, in Section [5l explicit dynamic state 
equations are derived in the form of ([I]). Since an explicit state dynamic 
equation does not have to exist for an arbitrary network, related existence 
conditions in terms of network topology are also included in Section [5j 

2 Preliminary Definitions and Results 

We start with a brief overview of basic algebraic facts and their graph in- 
terpretation which we will exploit in the development of max-plus algebra 
models of queueing networks. A detailed analysis of the max-plus algebra 
and related algebraic systems, as well as their applications can be found in 

[31 El HI El HUl [5] . 

Max-plus algebra is normally defined (see, e.g., [5]) as the system (JR, ©, (g>) , 
where JR = RU{e} is the set of real numbers with e = — oo adjoined, and the 
symbols © and (g) present binary operations determined for any x, y € JR 
respectively as 

x © y = max(x, y), x ® y = x + y. 

As one can verify [21 H|, most of the properties of the ordinary addition 
and multiplication, including their associativity and commutativity, as well 
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as distributivity of multiplication over addition, are extended to the opera- 
tions © and © . These properties allow usual algebraic manipulations in the 
max-plus algebra to be performed under the standard conventions regard- 
ing brackets and precedence of multiplication over addition. Note that, in 
contrast to the conventional algebra, the operation © is idempotent; that 
is, for any x £ JR , we have x © x = x . 

There are the null and identity elements in the max-plus algebra, namely 
e and e = 0, to satisfy the conditions xffie = e©x = x, and x®e = e©x = x, 
for any x € JR . The absorption rule which involves x®e = £®x = e is also 
true in this algebra. 

The max-plus algebra of matrices is introduced in the regular way [3, 
IBIS]. Specifically, for any (n x n) -matrices X = (acy) and Y = (yij), the 
entries of U = X © Y and V = X © Y are calculated as 

n 

Uij = Xij © yij, and Vij = ^ ^ e x^ © y^j, 

k=l 

where the symbol ^ e denotes the iterated operation ©. As the null ele- 
ment, the matrix £ with all its entries equal to e is taken in this algebra, 
while the matrix E = diag(e, . . . , e) with the off-diagonal entries equal to e 
presents the identity element. 

In perfect analogy to the conventional matrix algebra, one can define for 
any square matrix X , 

X° = E, X q = X © ■ ■ ■ © X for q = 1,2,... 

q times 

Note, however, that idempotency in the max-plus algebra leads, in particu- 
lar, to the identity [3] 

(E®X) q = E®X®---@X q . 

Many phenomena inherent in the matrix max-plus algebra appear to 
be well explained in terms of their graph interpretations [3J [SJ ITUt \5\ . To 
illustrate, we can consider an (n x n) -matrix X with its entries Xij £ JR, 
and note that it can be treated as the adjacency matrix of an oriented graph 
with n nodes, provided each entry Xij ^ e implies the existence of the arc 
in the graph, whereas x^ = e does the lack of the arc. The graph is 
then said to be associated with the matrix X . 

Let us calculate the matrix X 2 = X © X , and denote its entries by xf^ . 

(2) 

Clearly, we have x\- ^ e if and only if there exists at least one path from 
node i to node j in the graph, which consists of two arcs. Moreover, for any 
positive integer q, the matrix X q has the entry xf) ^ e only when there 
exists a path with the length q from i to j . 
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Suppose that the graph associated with the matrix X is acyclic. It is 
clear that we will have X q = £ for all q > p, where p is the length of the 
longest path in the graph. Assume now the graph not to be acyclic, and 
then consider any one of its circuits. Since it is possible to construct a cyclic 
path of any length, which lies along the circuit, we conclude that X q ^ 8 
for all (7 = 1,2,... 

Finally, we consider the implicit equation in the unknown vector x = 

{x\ , • • • , Xn) , 

x = u (g> x e v, (2) 

where U = (uij) and v = (v±, . . . , v n ) T are respectively given (n x n)- 
matrix and n -vector. This equation actually plays a large role in max-plus 
algebra representations of dynamical systems including systems of queues 
[HI El El - The next lemma offers particular conditions for ([2]) to be solvable, 
and shows how the solution may be calculated. One can find a detailed 
analysis of ([2]) in the general case in [5J. 

Lemma 1. Suppose that the entries of the matrix U and the vector v are 
either positive or equal to e. Then equation has the unique bounded 
solution x if and only if the graph associated with U is acyclic. Provided 
that the solution exists, it is given by 

x = {E®U) P ® v, 

where p is the length of the longest path in the graph. 

To prove the lemma, first note that recurrent substitution of x from 
equation (J2j) into its right-hand side, made q times, and trivial manipulations 
give 

x = u q+1 <8> x e (e e u e • • • e u q ) ® v . 

The rest of the proof may be readily furnished based on the above graph 
interpretation as well as on the idempotency of the operation ©. 

3 The Network Model 

In this section, we present a network model which may be considered as 
an extension of acyclic fork-join queueing networks investigated in [TJ [2]. 
In fact, we do not restrict ourselves on acyclic networks, but assume the 
networks to have an arbitrary topology. Moreover, we examine not only the 
networks with the infinite capacity of buffers in their nodes, but also those 
with finite buffers and blocking of servers. 
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Figure 1: A queueing network with n = 6 nodes. 
3.1 A General Description of the Model 

We consider a queueing network consisting of n single-server nodes, with 
customers of a single class, which circulate through the network. An example 
of the network under study is shown in Fig. [TJ 

The topology of the network is described by an oriented graph Q = 
(N, A) which, in general, does not have to be acyclic. In the graph Q , 
the set N = {1,... ,n} represents the nodes of the network, and the set 
A = C N x N consists of arcs determining the transition routes of 

customers. For any i, j £ N, the arc belongs to A if and only if the 

ith node passes customers directly to node j . 

For every node i £ N, we introduce the set of its predecessors P(i) = 
O'IO'j*) e A} and the set of its successors S(i) = £ A}. We 

suppose that, in specific cases, there may be one of the conditions P(i) = 
and S(i) = encountered. Each node i with P(i) = is assumed to 
represent an infinite external arrival stream of customers. Provided that 
S(i) = 0, the node is considered as an output node intended to release 
customers from the network. 

Each node ieN includes a server and its buffer which together present 
a single-server queue operating under the first-come, first-served (FCFS) 
queueing discipline. The buffer at the server in node i may have either 
finite or infinite capacity Sj ; that is, < Sj < oo . At the initial time, 
the server at each node i is assumed to be free of customers, whereas in 
its buffer, there may be rj , < < s, , customers waiting for service. 
It is thought that the values Sj = rj = oo are set for every node i with 
P(z) = 0, representing an external arrival stream of customers. We consider 
the numbers rj and Sj , i = 1, . . . , n, as initial conditions in the model. 

To describe the dynamics of the queue in node i, we use the following 
symbols: 

a,i(k), the feth arrival epoch to the queue; 
b{(k), the fcth service initiation time; 
Cj(fe), the &th service completion time; 
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di(k), the fcth departure epoch from the queue. 
Furthermore, the service time of the feth customer at server % is denoted by 
T~ik , Tik > 0. We assume that are given parameters for all % = 1, . . . , n, 
and k = 1,2, ... , while ai{k) , bi(k), and di(k) are considered as 

unknown state variables. In addition, with the condition that the network 
starts operating at time zero, it is convenient to set di(0) = e, and di(k) = e 
for all k < , i = 1, . . . , n. 

As one can see, relations between the state variables, which are actually 
determined by the network topology, initial conditions, and special features 
inherent in node operation, just represent the dynamics of the network. We 
will describe the network dynamics in more detail and give related algebraic 
representations in the subsequent sections. 

3.2 The Dynamics of Nodes 

We suppose that, in addition to the usual service procedure, special join 
and fork operations are performed in the nodes, respectively before and 
after service pp. With the condition that all buffers at servers in a network 
have infinite capacity, the fork-join mechanism may be described as follows. 

The join operation is actually thought to cause each customer which 
comes into node i, not to enter the buffer at the server but to wait until 
at least one customer from every node j € P(«) arrives. As soon as these 
customers arrive, they, taken one from each preceding node, are united to 
be treated as being one customer which then enters the buffer to become a 
new member of the queue. Note that only the customers who are waiting 
for service may be placed into the buffer at the node. Those customers 
which are ready to be joined, but, in the absence of all required customers, 
have not been joined yet, are assumed to reside in another place, say in 
an auxiliary buffer available at the node. It is suggested that the auxiliary 
buffers invariably have infinite capacity. 

The fork operation at node i is initiated every time a customer releases 
the server after completion of his service; it consists in giving rise to several 
new customers to substitute for the former one. As many new customers ap- 
pear in node i as there are succeeding nodes in the set S(i) . The customers 
simultaneously depart the node, each going to separate node j G S(i) . Fi- 
nally, we assume that the execution of the fork-join operations when appro- 
priate customers are available, as well as the transition of customers within 
and between nodes require no time. 

It is easy to see that, assuming the sets P(z) and S(i) to include no 
more than one node for each i € N , one can arrive at a queueing system in 
which essentially no fork-join operations are performed. As examples, both 
open and closed tandem systems may be considered [61 [7] , which actually 
present queueing networks with the simplest topology. 

In order to set up the equations which represent the dynamics of nodes, 
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let us first consider a network with infinite buffers. It follows from the above 
description of the fork-join mechanism that the time of the kth arrival into 
the queue at node i, which actually coincides with that of the completion 
of the fcth join operation, may be represented as [U[2] 

ai(k) = < jeP(i) (3) 
I e, if P(i) = 0, 

whereas the equations which determine the other state variables are readily 
written in the form 

bi{k) = ai(fc)©di(fc-l), (4) 
Ci(fc) = T ik ®bi{k), (5) 
di(k) = a(k). (6) 

Suppose now that the buffers at servers in the network may have limited 
capacity. In such systems, servers may be blocked according to some block- 
ing mechanism [21 [11] . The rest of the section shows how to represent the 
dynamics of nodes operating under the manufacturing and communication 
blocking rules, both being commonly encountered in practice. 

Let us first assume the network operation to follow the manufacturing 
blocking rule. Application of this type of blocking implies that, upon com- 
pletion of his service at node i , a customer cannot release the server at the 
node if there is at least one succeeding node j € S(i) in which the buffer is 
full. As soon as all nodes included in S(i) regain an empty buffer space, the 
customer leaves the server to produce new customers which have to depart 
node i immediately. 

The inclusion of manufacturing blocking leads us to the new equation 
representing departure times, which is to substitute for ([6]), 



where 

Vi{k) 




d i (k) = c i (k)ev i (k), (7) 

-sj-l), ifS(i)^0, 
if S(i) = 0. 

Clearly, equations jSHS]) remain unchanged. 

Finally, we suppose that the network operates under communication 
blocking. This blocking rule requires the server in node i not to initiate 
service of a customer until there is an empty space in the buffer in each node 
j S S(i). To represent the dynamics of node i, one may take equations ([3]), 
and Q respectively for ai(k) , Cj(&) , and di(k) . With the symbol T>i(k) 
introduced above, an appropriate equation for is now written as 

b i (k) = a i {k)@d i (k-l)®V i (k). (8) 
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4 A Vector Representation 

We now turn to the algebraic representation of the dynamics of the entire 
network. To describe the dynamics in a compact form, we introduce the 
vectors 



o(jfe) = 


(at(k), . 


.,a n (k)) T 


b(k) = 


(6i(fc),.. 


■,b n (k)) T , 


c(k) = 


(d(A0,.. 


■ i c n {k)) , 


d(k) = 


(di(k), . 


.,d n (k)f 



and the diagonal matrix 

/ T Xk e 

% = 



4.1 Networks with Infinite Buffers 

We start with the derivation of a vector representation relevant to equa- 
tions d3H6|) set up for networks with infinite buffers. First note that vector 
equations associated with (j3HH]) may be written immediately. 

To get equation ([3]) in a vector form, we define M r = max{rj|rj < 
oo, i = 1, . . . , n} . It is easy to see that we may now represent ([3]) as 

M r n 
m=0 j=l 

where the numbers are determined using the topology of the network 
by the condition 

rn = f e, if i G P(j) and m = r j: 
* J \ e, otherwise. 

Furthermore, we introduce the matrices G m = (^9ij^j f° r each m = 0, 1, . . . , M r , 
and then bring the above equation into its associated vector form 

a ik) = ^ e G^® d(k-m), 

where denotes the transpose of the matrix G m . Note that each matrix 
G m presents an adjacency matrix of the partial graph Q m = (N, A m ) with 
A m = e P(j), Tj = m}. 
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We are now in a position to describe the network dynamics in vector 
terms. By replacing equations ([3H6]) with their vector representations, we 
obtain 

M r 
m=0 

b(k) = o(Jfe) ®d(k - 1), 
c(k) = T k ®b(k), 
d(k) = c(k). 

Clearly, these equations can be reduced to an equation in one vector variable, 
say d(k) . In that case, appropriate substitutions will lead us to the equation 

d(k) = T k ®Gl® d{k) ®T k ® d(k - 1) 

M r 

eTfcO Y2s> G m® d ( k - m )- ( 9 ) 

m=l 

4.2 Networks with Finite Buffers 

Consider a network with finite buffers, and assume that it operates under the 
manufacturing blocking rule. With M s = max{sj + 1| Sj < oo, i = l,...,n}, 
equation (J7J) may be put in the form 

M s n 

diik) = a{k) e Y,® Z)e h ^ ® d i( k ~ m )' 

m=l j=l 

where 

h m = f e, if j G S(i) and m = Sj + 1, ^ 
*■? 1 e, otherwise. 

In a similar way as in Section 14. 1\ one can introduce the matrices H m = 
(j^ifj , m = 1, . . . ,M S , and then rewrite ([7D so as to get a representation 
for d{k) . 

Taking into account that the equations set up previously to represent the 
vectors a (k) , b(k) , and c(k) remain valid, we arrive at the set of equations 

M r 

a ( k ) = Y^G^^dik-m), 

b(k) = a(k)®d{k-l), 
c{k) = T k ®b(k), 

Ms 

d(k) = c(k)e^2 B H m ®d(k-m). 

m=l 
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Without loss of generality, we consider that M r = M s = M . If it 
actually holds that M r < M s (the inequality M r > M s is contradictory to 
the initial conditions), one may set M = M s , and then define G m = £ for 
all m = M r + 1, M r + 2, . . . , M s . With this assumption, we may drop the 
subscripts so as to write M instead of both M r and M s . 

Proceeding to an equation in d(k) , we get 

d(k) = T k ®Gl® d{k) © T k ® d(k - 1) 

M 

®^®{Tk®Gl l @H m )®d{k-m). (11) 

m=l 

Let us now assume the network to follow the communication blocking 
rule. In the same way as for manufacturing blocking, one may define matri- 
ces Hi, ... , Hm through (fTQ|) . and represent equation ([8|) in its vector form. 
The set of vector equations describing the network dynamics then becomes 

M 

a ( k ) = ^^G^^dik -m), 

m=0 

M 

b(k) = a(k) d(k - 1) ^ ffi H m (g> d(k - m), 

m=l 

c(k) = T k ®b(k), 
d(k) = c(k). 

Finally, by combining these equations, we have 

d(k) = T k ®Gl® d(k) © T k ® d(k - 1) 

M 

®Tk®^ @ (G T m ®B m )®d(k-m). (12) 

m=l 

5 The Explicit State Equation 

Let us consider equations ([9]), (fTT|) . and (fT2|) derived above, and note that 
they actually present implicit equations in the system state variable d(k). 
In this section, we show how these equations may be put in their associated 
explicit forms which are normally more suitable for analytical treatments 
and computer simulation of the network dynamics. Since, in general, the 
implicit equations do not have to be explicitly solvable, the conditions for 
an explicit state equation to exist are also established. 

In order to examine the implicit equations, we first note that they all 
take the form of (J2J with U = Tk ® Gq . Since the matrix Tk is diagonal, 
each graph associated with the matrix Gq will be likewise associated with 
U. In addition, the graph associated with the matrix Go and that with 
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its transpose are both acyclic or not at once. Finally, both graphs have a 
common length p of their longest paths. 

Now it is not difficult to apply Lemma [1] so as to prove the following 
statement. 

Theorem 2. Suppose that in the network model with infinite buffers, the 
graph Q$ associated with the matrix Gq is acyclic. Then equation © can 
be solved to produce the explicit state dynamic equation 



M 



d(k) = ^ ffi T m (k) ® d(k - m), 



(13) 



m=l 



with the state transition matrices 



T{k) = {E®T k ®GlY ®T k ®(E®C%), 
T m {k) = (EeTk®G%) p ®T k ®Gl, 
m = 2,... ,M, 

where p is the length of the longest path in Qq . 

As one can see, the matrix coefficient at d(k) on the right-hand side 
of both equation pTj) and (fT2]) . which is just responsible for explicit rep- 
resentation (|13p to exist, remains the same as in equation Q set up for 
the network with infinite buffers. We may therefore conclude that entering 
finite buffers into the network model has no effect on the existence of its 
associated explicit dynamic state equation. 

Now one can reformulate Theorem to extend it to the networks with 
finite buffers. In short, under the same conditions as in the theorem, equa- 
tions (|lip and (|12p may be put in the form of (|13|) . with the state transition 
matrices defined respectively as 



Ti(k) 
T m (k) 



(E < 
m 



% 
% 
= 2,. 



■ Glf ® (T k T k ® Gl e 



Gly 

.,M, 



and 



Ti(fc) = (E © T k ® Glf ® T k 
T m (k) = (E@Tk® Gq) p (g) % 
m = 2,...,M. 

Finally, with the extended state vector 

/ d(k) 
d{k-l) 



d(k) 



(EQ 



Gji 

Hn 



\ d{k - M + 1) / 



^i), 
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we may bring (|13p into the form of ([I]): 

d(k) = f(k) <g> d(k - 1), 



where the new state transition matrix is defined as 



/ T x {k) T 2 {k) 
E 8 



T M (k) \ 
£ 



f(k) 



E 



In conclusion, let us assume that for a network, the partial graph Qq has 
a circuit. We may consider the network depicted in Fig. [1] as an appropriate 
illustration if we put r 2 = r% = = . In that case, there is the circuit in the 
graph Qo, including nodes 2,3, and 4. Then, as it follows from Lemma [H 
the implicit dynamic equation associated with the network cannot be solved 
in an explicit form. 

One can see, however, that it is easy to make the equation solvable 
only by setting new initial conditions, without changing the network topol- 
ogy. Since Q = (N,A ), where A = G P(j), r,- = 0}, we may 
eliminate arcs from the graph Q$ by substituting nonzero values for some 
parameters rj set initially to 0. One can compare the network in Fig. [H 
under the conditions r 2 = = = 0, with that subject to r 2 = = 0, 
and r3 = 1 , as an example. 
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